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Abstract 

The present paper is devoted to the study of average consensus problems for undi¬ 
rected networks of dynamic agents having communication delays. The accent is put 
here on the study of the time-delays influence: both constant and time-varying de¬ 
lays are considered, as well as uniform and non uniform repartitions of the delays in 
the network. The main results provide sufficient conditions (also necessary in most 
cases) for existence of average consensus under bounded, but otherwise unknown, 
communication delays. Simulations are provided that show adequation with these 
results. 


1 Introduction 

In the last few years, the study of multi-agent systems has received a major at¬ 
tention within the control community. Driving applications include unmanned 
aerial vehicles, satellite clusters, automated highways and mobile robots. In 
all cases the aim is to control a group of agents connected through a wireless 
network. More precisely, rather than stabilizing the movement of each agent 
around a given set point, the goal is to understand how to make the agents co¬ 
ordinate and self-organize in moving formations. This problem becomes even 
more challenging under partial communication protocols, i.e. when each agent 
exchanges information only with few others. 

Many works in the literature focused on conditions for guaranteeing that the 
agents asymptotically reach a consensus, i.e. they agree upon a common value 
of a quantity of interest [11], [18], [19], [16], [17], [4]. As an example, in a net¬ 
work of moving vehicles a form of consensus is represented by alignment, that 
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happens when all vehicles asymptotically move with the same velocity. In the 
aforementioned papers, consensus problems have been studied under a variety 
of assumptions on the network topology (hxed/switching), the communication 
protocol (bidirectional or not), additional performance requirements (e.g. colli¬ 
sion avoidance, obstacle avoidance, cohesion), and the control scheme adopted 
(also termed consensus protocol). So far, just few works considered consensus 
problems when communication is affected by time-delays. Some results for 
discrete-time agent models are given in [5] and [1]. Two different consensus 
protocols for continuous-time agent dynamics have been investigated in [14] 
and [16]. More specihcally, assuming that agents behave like integrators and 
that communication delays are constant in time and uniform (i.e. they have 
the same value in all channels), an analysis of the maximal delay that can 
be tolerated without compromising consensus has been performed in [14] and 
[16]. In particular, the protocol adopted in [16] is capable to guarantee aver¬ 
age consensus (i.e. the state of each agent converges, asymptotically, to the 
average of the initial agent states rather than to an arbitrary constant) and 
the authors provide an explicit formula for the largest transmission delay. 

In the present work we generalize the results of [16] in various ways. First, we 
consider uniform and unknown time-varying delays and provide upper bounds 
to the maximal delay that does not prevent from achieving average consensus. 
Second, we derive similar conditions for networks affected by non uniform, 
constant or time-varying delays. In the case of non uniform and constant 
delays, we also show that if the communication delay between two agents 
is equal to zero, then average consensus may achieved irrespectively of the 
magnitude of all others delays. 

The network of agents is modeled in the framework of Partial difference Equa¬ 
tions (PdEs) introduced in [2] and used in [4] analyzing the property of various 
linear and nonlinear consensus protocols. PdEs are models that mimic Partial 
Differential Equations (PDEs) and provide a mathematical description of the 
agents network where “spatial” interactions (due to the network structure) 
and “temporal” ones are kept separated and described by operators acting ei¬ 
ther on space or time. Section 2 provides an introduction to PdEs. The main 
results are presented through Sections 3-6 and three simulation experiments 
are discussed in Section 7. The upper bounds to the maximal tolerable de¬ 
lay depend on some eigenvalues of suitably dehned operators. Although their 
numerical computation is easy for a given network, in Section 7.1 we provide 
their explicit form as a function of the network size for fully connected and 
loop-shaped network. 


2 Tools for functions on graphs 

The communication network is modeled through an undirected weighted graph 
G dehned by a set A/” = {1, 2,..., N} nodes and a set T C J\f x Af of edges. 
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Fig. 1. A graph and the subgraphs associated to delays ti and T 2 

Each node represents an agent and an edge (x, y) means that the agents x and 
y share the information about their states. Agents linked by an arc are called 
neighbors. The neighboring relation is denoted with x ^ y and we assume that 
X ~ X always holds. Two nodes x and y are connected by a path if there is 
a hnite sequence xq = x,xi,... ,Xn = y such that Xj_i ~ x*. The graph G is 
connected when each pair of nodes {x,y) E G x G is connected by a path and 
complete ii S = G x G. 

Weights on the communication links are dehned by a function uj : AfxAf ^ M"*" 
with the properties 


uj{x,y) = uj{y,x) (la) 

a;(x, y) > 0 X y (lb) 

Time-varying delays in communications, are elements of the set 

® = {TiO : * 6 I}, I={l,...,r}, (2) 

where r* : M+ i—*• M+ are piecewise continuous functions. A delay is associated 
to each edge through the onto function T : S ^ V verifying T(x, y) = T{y, x). 
The last equality amounts to consider delays that are symmetric, i.e. the lags 
in transmission from x to y and from ?/ to x do coincide. This also motivates 
the bound r < in (2). 

Agents linked with the same delay ri(-), dehne a subgraph Gi = (A/*, T“^(ri)) 
with associated weights 


i^i{.x,y) 


a;(x, 2 /) if (x,|/) e T i(ri) 
0 otherwise 


( 3 ) 


An example is reported in Figure 1. We highlight that the subgraphs Gi may 
be disconnected even if G is connected. Moreover, as shown in Figure 1(c), 
some nodes can be isolated. 

We consider now vector functions / : A/” i-->- dehned over a graph G. For 
instance, /(x) may represent the position or the velocity of the agent x at a 
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fixed time-instant. Following [2], the partial derivative of / is defined as 


dyf{.x) = f{y) - f{x) (4) 

and enjoys the following basic properties: 

dyf{x) = -d^f{y) (5a) 

dxf{x) = 0 (5b) 

dyf{x) = dyf{y) - dyf{x) = -dyf{x). (5c) 

The integral and average of / are dehned, respectively, as 

f f dx=Y^ f{x), (f) = ^ f f dx. ( 6 ) 

Note that, in (6), “da;” just indicates the integration variable. The Laplacian 
of / is given by 

^f\x) = - ^ u{x, y)dlf{x) = +Y^ y)dyf{x). (7) 

y'^x y'^x 

where the last identity follows from (5c). In an equivalent way, the Laplacian 
can be written as 

A/(a;) = J^uj{x,y)dyf{x) dy (8) 

The Laplacian operator associated to a subgraph Gi is 

^if{x)=[uji{x,y)dyf{x)dy (9) 

G 

Since the sets of edges {T“^(ri)}jgx are a partition of T, it is immediate to 
verify that 

^{x,y) = ^Ui{x,y) and A/ = ^Ai/ (10) 

igx ieJ 

In the sequel we summarize the main properties of the Laplacian operator 
stated in [2]. The driving idea is to mimic functional analysis tools for studying 
the classic Laplacian dehned on Sobolev spaces, (see [2] and [4] for further 
details). 

We denote with L^(G|M'^) the Hilbert space composed by all functions / : 
A/” I— > equipped with the scalar product and the norm 

{L9)l^= [ f-9, \\f\\h=[\\ff ( 11 ) 

where ■ and || ■ || represent the scalar product and the euclidean norm on 
respectively. Let i7^(G|M'^) be the space collecting all functions in //^(GIM*^) 
with zero average. We will use the shorthand notation and when there 
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is no ambiguity on the underlying domain and range of the functions. If G is 
connected, is an Hilbert space [2] endowed with scalar product 


(/) 9)h^ 


/ / uj{x,y)dyf{x)-dyg{x)dxdy. 
J G J G 


( 12 ) 


Apparently, is the space of constant functions on G and dim(iJ|) = d. 
Moreover, the decomposition (BH]_ is direct. The orthogonal pro¬ 

jection operators on and will be denoted as and , respectively. 

The eigenstructure of the Laplacian is completely characterized by the next 
Theorem, proved in [2]. 

Theorem 1 Let G he a connected graph. Then, 

(1) the operator A : i—> is symmetric, it has {N — l)d strictly negative 

eigenvalues'^ and the corresponding eigenfunctions form a basis for 

(2) for f G A/ = t) if and only if f G Hf. 

Theorem 1 highlights that the Laplacian is invertible on the subspace H^. Note 
that when A is dehned on L^, it has Nd eigenvalues. In particular, in view of 
the decomposition © H]_, [N — l)d eigenvalues are those considered 

in point (1) of Theorem 1 and the remaining d are zeros (this property follows 
directly from point (2) of Theorem 1). 

The next theorem characterizes the eigenvalues of the operators Aj. 

Theorem 2 The operators A* ; , i E I, are symmetric and negative- 

semidefinite. 

Proof: As in the proof of [2, Lemma 3.1], by direct calculation one has that 
\/u,v G it holds (Ajti, n)i 2 = —ai{u,v) where a is the symmetric bilinear 
form given by 


ai{u,v) 


1 

2 


’Gi JGi 


uii{x,y)dyu{x) ■ dyv{x) dxdy 


(13) 


Then, {Au,v)l 2 = —a{u,v) = —a{y,u) = {u,Av)l 2 that proves the symmetry 
of A. For proving that Aj is negative semidehnite, it is enough to show that 
{—AiU,u)L 2 > 0, Vm G L^. One has 


{-AiU,u)L 2 = ai{u,u) = ^ / [ ^^i{x,y)\\dyu{x)\\‘^ dxdy (14) 

^ «/ Gi Gi 


where the last term is non negative in view of (3) and (lb). ■ 

We stress that all the spaces so far introduced are hnite dimensional. This can 
be seen by noting that the lifting operator C ; L^(G|M'^) i—> defined as 

r iT 




f{ir--- f{Nr 


( 15 ) 


Such eigenvalues will be termed “the eigenvalues of A on P 


In 
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is an isometry (i.e. bijective and ||/||l 2 = ||£(/)||) so showing that is 
isomorphic to Roughly speaking, this means that all concepts introduced 
in the present section could be re-written in terms of vector and matrices over 


Definition 1 Consider the linear operator A : i—> Its 

matrix representation is the unique matrix M.{A) G that verifies 

CiAf) = MiA)Cif),yf e L^iGlR^^). 

The matrix representation of an operator can be used, for instance, for com¬ 
puting the eigenvalues of A since they coincide with the eigenvalues of A4{A), 
up to their multiplicity. The operator A is strongly related to the Laplacian 
matrix of the graph G, dehned next (see also [3]). In the sequel, the x-th. row 
and the {x,y) element of a matrix B will be denoted with {B)x and {B)x,y, 
respectively. 


Definition 2 For a graph G, the adjaceney matrix A(G) is an N x N matrix 
with entries 




uj{x,y) ifx y and x ^ y 
0 otherwise 


(16) 


The valency matrix V(G) is an NxN diagonal matrix with entries (V(G))x,x = 
d'lT'd the Laplacian matrix is L{G) = A{G) — V{G). 


It is easy to verify that C{Af{x)) = {L{G)®Id)C-{f), where ® is the Kronecker 
product and Id the identity matrix of order d Then, AI(A) = L{G) ® Id- 


3 Delayed multi-agent models and PdEs 

Let v{x,t) G and u{x,t) G x G fif, t G M"*" denote the state and the 
control input of agent x at time t, respectively. When each agent behaves as 
an integrator, the collective dynamics is described by the equation v{x,t) = 
u{x,t), where the dot operator indicates the time-derivative. In this paper we 
consider delayed Laplacian protocols of the type u = Y.iei — rfit)) 

yielding the collective dynamics 

h = ^ Ain(a;,f - ri(t)) (17) 

iex 

Formula (17) dehnes a time-delay Partial difference Equation (PdE) (see [4] for 
a general dehnition of PdEs) whose solution depends on the initial conditions. 
As for linear time-delay systems, if all delays are bounded by a constant f, 
the initial condition may be given in form of a function v {x, f) G X E M, 
t G [—f, 0], continuous in t. 

As shown in [4], PdEs can be always recast into Ordinary Differential Equa¬ 
tions by using the lifting operator (15). Then, it is not surprising that linear 
time-delay PdEs inherit all the properties of linear time-delay systems. As an 
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example, if all delays are constant in time, the characteristic equation associ¬ 
ated to (17), is 

E{s) = si = see (18) 

i£j 

where I is the identity operator on L^. Then, many properties of the network 
of agents can be characterized in terms of the poles of (17), i.e. the roots of 
(18). We outline that if the delays are constant, model (17) coincides with the 
network dynamics considered in Section 10 of [16]. 

The main goal of the present work is to investigate when (17) guarantees 
average consensus. 

Definition 3 The network dynamics achieves average consensus ifv —> (n(-, 0)) 
as t ^ +CX). 

In absence of delays, u results in the Laplacian protocol, and the PdE (17) 
reduces to the heat equation 


i] = Av v{-,0)=veL‘^ (19) 

The consensus properties of Laplacian protocols have been analyzed in vari¬ 
ous works. In particular, A. Jadbabaie et al. [11] proved that the Laplacian 
protocol is able to guarantee average consensus under various assumption on 
the network topology. A formal analysis of the PdE (19) has been carried out 
in [4], where it has been also shown that the Laplacian protocol can guaran¬ 
tee consensus even when the agent dynamics are perturbed by exponentially 
decreasing errors and/or an agent acts as the leader of the group. 

In order to highlight the rationale we will use for analyzing the PdE (17), 
let us summarize the main results of [4] for the collective dynamics (19). 
Decomposing the velocities as n = ui 4- h, ui e Hi, v = {v{-, t)) e H]_, one can 
show, through a simple variational technique, that the velocity components 
fulhll the dynamics 


n = 0 (20a) 

hi = Aui (20b) 

thus proving that the spaces Hi and H]_ are positively invariant for (19). In 
particular, equation (20a) highlights that the average velocity of the agents is 
constant in time. Then an exponentially stable average consensus is achieved 
if the origin of (20b) is exponentially stable, a fact that can be easily shown 
by exploiting the characterization of the eigenvalues of A on H^ given in 
Theorem 1. In [4] it is also shown that average consensus can be intuitively 
expected on the basis of the physical analogy between (19) and the classic 
heat equation. 

For the delayed model (17), we will adopt a similar argument. The next Lemma 
provides the dynamics of the vi and v components. 
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Lemma 1 The function v is solutions to the PdEs (17) if and only if Vi and 
V, are solutions to the PdEs 


Si: Vi = '^AiVi{x,t-Ti{t)), E: v = 0 (21) 

i£j 

equipped with the initial conditions vi{-,t) = PHiv{-,t), v(t) = PHiv{-,t) for 

Proof: To prove the result, we use a variational argument by testing each side 
of (17) against all c G Hf. This means that we take the integrals 

f c - V dx = f c ■ EA. v{x,t — Ti{t)) dx (22) 

Jg Jg jgj 

By using (9), the right side of (22) can be written as J2i^x Si, where 


Si= / c - / Ui{x,y)dyv{x,t - Ti(t)) dydx (23) 

Jg Jg 

From (la) and (5a), the functions gi{x,y) = uii{x,y)dyv{x,t — Tiit)) are anti¬ 
symmetric, i.e. gi{x,y) = —gi{y,x). Then, each integral Si can be expanded 
into sums containing only terms of the type c ■ {gi{x, y) + gi{y, x)) that are all 
identically equal to zero. The fact that c ■ v dx = 0, Vc E Ilf corresponds 
to the condition = 0, or, equivalently, to u = 0, thus obtaining the 

dynamics S. From (17) we have 

vi+f = J2AiVi(x,t- Ti(t)) + J2Aiv(x,t- Ti(t)) (24) 

i€X ieX 

and the dynamics Si follows from 7 = 0 and AjU = 0. ■ 

Lemma 1 shows that the spaces 77^ and Ilf are positively invariant for the 
PdE (17). Moreover, as for (19), the average state v is constant in time and 
equal to (v(-, 0)). Then, the problem of checking average consensus is reduced 
to the problem of proving that Ui —0 as t cx). We also say that average 
consensus is globally exponentially or asymptotically stable if the zero solution 
to Si enjoys the same property, i.e. it is exponentially or asymptotically stable 
for all initial conditions v{-,t) E , t E [—f,0], continuous in t. 

For subsequent use, we introduce the operator norm ||A|| = max^gii^i = 

I Amin I where \min IS the minimal eigenvalue of the Laplacian on . Similarly, 
by recalling that A is invertible on H^, one has ||A“^||“^ = |Amax|- 


4 The case of uniform delays 

In this section, we analyze the stability properties of the dynamics Si when 
the delay is uniform in the network, i.e. when X is a singleton. We start with 



the simpler case of time-invariant delays, considered also in [16]. The results 
of the next Theorem coincide with those of Theorem 10 in [16], but are proved 
through a different argument, i.e. the diagonalization of the Laplacian operator 
on TTh 

Theorem 3 (Constant delay) The zero funetion is a globally exponentially 
stable solution to the PdE 

Vi{x,t) = Avi{x,t — t), Vi E (25) 


for all possible r < r, if and only if 


2||A|| ■ 


(26) 


Proof: In view of Theorem 1, the Laplacian can be diagonalized on Let 
be an orthonormal set of eigenfunctions of A forming a basis for 
and associated to the eigenvalues Then Vi{x, t) = OLi{t)il)i{x) 

for suitable functions a* : R"*" i—> R. By testing each side of (25) against tfjj we 
form the integrals 



(27) 


By Theorem 1, formula (27) reduces to 

a jit) = Xjajit — t) (28) 

System (28) is a first-order linear time-delay system. Since Xj < 0, according 
to [9, Theorem A.5], system (28) is exponentially stable if and only if r < 
Then, the PdE (25) is exponentially stable if and only if all systems (28), for 
j = 1,..., {N — l)d are exponentially stable, i.e. if (26) holds. ■ 

Remark 1 For h > 0, it may be of interest to quantify the largest delay fh 
for which an exponential decay rate h is guaranteed for the solutions to (25). 
By using the diagonalization procedure in the proof of Theorem 3, and noting 
that systems (28) are asymptotically stable for r = 0, the quantity fh is the 
smallest r > 0 for which there exists ci; G R such that 

+ = 0. (29) 

Using the fact that if u verifies (29) also —u verifies (29), one obtains u = 
Y/llAPe^^"^ — Furthermore, summing up the real and complex parts of equa¬ 
tion (29) yields 

fh = min |r > 0 : || cos ^r-y/|| Ape^^^ — = h| . 
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Note that the map h ^ fh is decreasing, with Tq = 7r/2||A||, and f||A|| = 0. 

We consider now the case of a single time-varying delay. 

Theorem 4 (Time-varying delay) The zero solution is a globally exponen¬ 
tially stable solution to the PdE 

Vi{x, t) = Avi{x, t — T{t)), Vi{-,t) e (30) 


for all piecewise continuous delays rit) verifying 0 < r(t) < t, if and only if 


3 

2M' 


(31) 


Proof: As in the proof of Theorem 3, diagonalization of the Laplacian on 
leads to the study of the first-order systems dj = Xiaiit — rit)), for any 
eigenvalue Xi of A on . 

The conclusion is then deduced from a classical result initially published in 
[15] and [20], (see also [9, p. 164] and the references therein). ■ 

If the nominal collective model is the PdE (19), Theorems 3 and 4 characterize 
the robustness of average consensus with respect to different delay models. 
In particular, the bounds given in Theorems (26) and (31) do not depend 
upon the precise structure of the communication network but only upon the 
magnitude of ||A||. In other words, by interpreting G as the “spatial” domain 
of the PdEs (25) and (30), bounds (26) and (31) relate the maximal tolerated 
delays to a spatial feature. Explicit formulas for ||A|| in the case of complete 
and loop-shaped networks are given in Sections 7.1.1 and 7.1.2, respectively. 
Other results linking the graph structure with the eigenvalues of the Laplacian 
operator can be found in [7], [6] and [13]. 

We also outline that the constant in (31) is smaller than the corresponding one 
in (26), the greater conservativity arising from the time-varying nature of the 
delay. However, the bound (31) is the best possible one since the corresponding 
stability condition is necessary and sufficient. 


5 The case of non-uniform delays 

In this Section, we generalize the results of Section 4 to the case where the 
delays do not take a common value in the whole network. Let us consider 
first the case of constant delays. The next Theorem provides a robust stability 
result for all possible delays r* within the interval [0,r]. Quite remarkably, the 
bound (26) still gives a necessary and sufficient condition for stability. 

Theorem 5 (Constant delays) The zero solution is a globally exponentially 
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stable solution to the equation 


vi{x,t) =^^iVi{x,t-Ti), Vi{-,t)eH^ (32) 

iex 

for all possible Ti < f, i E T, if and only if (26) holds. 

Proof: By considering the case Ti = f, i eX, Theorem 3 shows that the npper 
bound to the tolerated delay cannot be larger than 7r/2||A||. 

We prove by contradiction that (26) implies asymptotic stability. Assume that 
(32) is not asymptotically stable. For zero delays, the PdE (32) reduces to PdE 
(20b) whose global exponential stability has been proved in [4]. By continuity 
of the poles of (32) with respect to the delays, there exists a choice of the 
Tj E [0, f], i G X, for which the PdE (32) has a purely imaginary pole joj, oj E 
M\{0}. In other words, there exists a nonzero eigenfunction u E i/^(G|C^)\{0} 
such that 

(ju;I-J2A,e-^^Au = 0, 

\ iGJ / 

where I is the identity on This implies that 

+ = (33) 

iex 


where, by denoting with u* the complex conjugate of m, one has 


Jg u* ■ AjU 
JgU*-u 


i E I . 


Notice that, by Theorem 2, the operators Aj are symmetric, negative semidef- 
inite on H^. Thus, one has Oj > 0 for all i E X. On the other hand, 

yQ,<||Al|, (34) 

i€.I 


Considering the real and imaginary parts of (33), we deduce that 

CTj cos UTi = 0, (35a) 

a; — sincuTi = 0 . (35b) 

i£j 

From (34) and (35b), one gets that |c<;| < ||A||, whence \u\Ti < ||A||f < tt/2. 
In these conditions, the terms cos UTi appearing in (35a) are all positive. Note 
that not all the coefficients ctj can be zero, otherwise /g u* ■ Au = 0, which 
contradicts the fact that u E \ {0}. Therefore (35a) is impossible, and we 
are thus led to a contradiction. This proves that if < r and (26) holds, then, 
the PdE (32) is globally asymptotically stable. ■ 
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We stress once more the robustness flavor of Theorem 5, that requires just the 
knowledge of a common upper bound f on the (unknown) delays Tj. On the 
other hand, there may exist combinations of delays such that Ti > r, for 
some i G X, but the PdE (32) remains asymptotically stable. An example is 
provided in Section 7. 

The argument used in the proof of Theorem 4 does not seem to extend to 
the case of non-stationary delays. In this case, the next Theorem provides a 
sufficient stability condition. 

Theorem 6 (Time-varying delays) The zero solution is a globally stable 
solution to the PdE (17) for all nonnegative, piecewise continuous delay Ti(t) 
verifying 0 < rj(t) <f, if 


1 

Theorem 6 is a direct consequence of the following stronger result. 

Lemma 2 The zero solution is a globally stable solution to the equation (17) 
for all piecewise continuous nonnegative delay Ti(t) verifying 


(36) 


sup 

ie[0,-|-oo) 


Ti{t)\\AiAi 




<1/1|A-'|| . 


(37) 


Proof: One may write 

hi = '^AiVi{x,t- Ti(t)) = Avi{x,t) p'^Ai {vi{x,t - Ti(t)) - vi{x,t)) 

i£j i£j 

= Aui (x, t) — '^Ai / hi {x, s) ds 

ieJ dt-Ti{t) 

= Avi{x,t) - ^ Ai [ Ai>vi{x,s - Tifs)) ds . (38) 


Let p be the constant 

P^= sup I Y, p(t)||AiAi/|| I ||A"^|| < 1 . 

ie[0,+oo) j 

By assumption, there exists a real number q in the non empty interval (1,1/p). 

We apply now Razumikhin theorem, see e.g. [9, Theorem 4.2] or [12, Chapter 
4]. For V{vi) = IIIuiIIlz, assume that R(ni(-,s)) < qV{vi{-,f)) for all s G 
\t — 2r, fj. From the expression of hi in (38), one deduces that, along the 
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trajectories of (17), it holds 


d\VM] 

dt 


< (-||A ^11 ^ + g A(t)||AjAi 

V*,*'ex 

<i|A-^||-^(-l + gp)||t;i|U. . 




Then, < 0 and the thesis follows. ■ 

’ at 

The results in Theorems 3, 4, 5 and 6 are summarized in Table 1. 


r 

Uniform delays 

Non-uniform delays 

Time-invariant delays 

2||A|| (^) 

2||A|| (^) 

Time-varying delays 

2||A|| (^) 



Table 1 


Bounds on the worst-case stabilizing delay. E: exact, S: sufficient. 

Remark 2 By comparison with (31), the bound (36) depends in a more in¬ 
volved manner upon the structure of the communication network. We also 
highlight that the bound (36) may be bounded from above by the simpler guan- 
tity l/( TrA)^|| A“^||, where TrA is the trace of the Laplacian on . 

For checking that the results of Theorems 4 and 6 are coherent, one can use 
the following inegualities 


Y. ||A,A,||||A-‘||> 



E 



= ||A2||||A-^||>||A|| , 


that imply (36) < < fj]^- ^^so, we highlight the trade-off between stability 

with large delays on the one hand, and large decay-rate of the solutions on the 
other hand: the first one reguires a small || A||, whereas the second one reguires 
a large ||A“^||“^ < ||A||. 


6 A delay-independent condition for average consensns 

According to the standard terminology in time-delay systems, all the results 
presented in Sections 4 and 5 are “delay-dependent” in the sense that they 
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guarantee average consensus when all the communication delays are upper- 
bounded by a suitable value f. Next, we show that if a single delay is zero, 
average consensus may be achieved irrespectively of the magnitude of all other 
delays. In this sense, we provide a “delay-independent” condition for average 
consensus. For two operators A and B from to the inequality A > B on 
means that 


WueH^\ {0}, {u, {A - B)u)l 2 > 0 . (39) 


Theorem 7 Consider the PdE (32) and assume that Ti' = 0 for an index 
i' G 1. If 

Ai,< Y. (40) 

iex\{i'} 

then, the zero solution is a globally exponentially stable solution to (32) for 
(iny Tj > 0, i G X \ {i'}. Conversely, if the zero solution to system (32) with 
Ti' = 0 is globally asymptotically stable for any r* > 0, i G X \ {i'}, then 

Ai' < Y onHK (41) 


Proof: Assume hrst that (40) holds. Then, for any Zi E C, i E T \ {i'}, such 
that \zi\ < 1, one has 


Ai' + 


E 


Zi^i 


+ A^. 


E 


^iAi 


< 2 A, 


A,. 


< 


0 on 




Consequently, Aj/ -|- J2iGj\{i'} has only eigenvalues with strictly negative 
real part on for any \zi\ < 1. This implies that, for any s G C with Re s > 0, 
the following inequality holds on H^\ 


[s + s*)I > 0 > 2 I Ai/ + E A. 


— Aj' + Y^ + E RAj 


(42) 






In particular, one can choose Zi = e in (42), because |e < 1 when 
Re s > 0 and > 0. Thus, 


si — A,/ — 




+ si — Aj/ — 




E 




> 0 


(43) 


for any r* > 0, i G X\ {F}. As a consequence, all the roots of the characteristic 
equation det(s/ — Aj* — ^“^'^‘Aj) = 0 of (32) have strictly negative 
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Fig. 2. The multi-agent system, with the communication delays, used in Section 7. 
real part. This yields the delay-independent asymptotic stability of (32). 

Conversely, assume that (41) is not fulhlled. Then, 

A..- ^ A, 

admits a real positive eigenvalue. In these conditions, system (32) is not delay- 
independently stable, see [10,8]. ■ 


7 Examples 


We stress once more that the results in Sections 4 and 5 characterize robustness 
of average consensus, i.e. average consensus for any value of the delays less or 
equal to f. In order to illustrate this concept, we consider the network of three 
agents whose communication graph G is represented in Figure 2. 

We assume that v{x,t) G M^, that the weights uj{x,y) = 1 x ~ ?/ are used 
and that the delays r* > 0, z = 1, 2 are constant in time. Moreover, the agents 
evolve according to the PdE (17) starting from the initial conditions 

h(l,f) = [2, 2]', h(2,t) = [2, -2]', h(3,t) = [1, 3]' 

where t G [— max{ri, T 2 }, 0]. The average velocity at time t = 0 is h = [|, 1]'. 

From Theorem 1, the eigenvalues of A on are the non null eigenvalues 
of A4{A) (up to their multiplicity). In our case, one gets ||A|| = 3, and the 
bound (26) is equal to 7r/6 ~ 0.524. 

In the hrst experiment, we choose the delays ti = r 2 = 0.51 that are slightly 
below r. Then, Theorem 3 guarantees average consensus and such a result can 
be verihed from Figure 3(a), where the evolution of \\v{x,t) — h||, x G {1,2,3} 
is represented. In the second experiment, we use Ti = r 2 = 0.53, so having ti = 
T 2 > f. As predicted by Theorem 3, the dynamics of Vi becomes unstable and 
average consensus cannot be achieved. This can be clearly seen in Figure 3(b). 
Finally, we choose ti = 0.1 and T 2 = 0.7. In this case, T 2 violates the bound of 
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(a) Ti = T 2 = 0.51 (b) Ti = T 2 = 0.53 

Fig. 3. Time evolution of q{x,t) = \\v{x,t) — i;|| for the multi-agent system in Fig¬ 
ure 2. 



time [s] 


Fig. 4. Time evolution of q{x,t) = \\v{x,t) — u|| for the multi-agent system in Fig¬ 
ure 2, with Ti = 0.1 and T 2 = 0.7. 

Theorem 3. However, ti < f and Theorem 3 cannot be nsed for checking the 
average consensns property. In this case, the achievement of average consensus 
can be verihed by simulation, as shown in Figure 4. 

7.1 Two extremal cases 

We now consider the case of complete and loop-shaped graphs with uniform 
weights. In Sections 7.1.1 and 7.1.2 it is shown that the bounds of Table 1 can 
be computed in closed-form as a function of N. 

7.1.1 Complete graph 

We consider a complete graph G characterized hy £ = Af x M and ui{x, y) = 
(5 > 0. We assume that a single delay Tx,y is associated to each edge. Since 
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delays are symmetric, then V = {Tx^y, (x, y) G X} where X = {(x, y) G G x G : 

X < y} and the cardinality of r of X, dehned in (2), is Note that 

the only difference with respect to (2) is that delays are parametrized by two 
indexes. One also has that Gx,y = = {{x, y), {y, x)} and, by 

direct computation, 

[0 iH^Gx,y 

(A,,„/)«) = Hfiy) - f(x)) if ? = I (44) 

(HfM-fiy)) = 

The matrix representation of A^, ^ is given by 

M(Ax,y) = -5ex,yely ® h ( 45 ) 

where e^^y is dehned as the vector in with zero entries, except the x-ih. 
one, equal to 1, and the y-th. one, equal to —1. Note that, from (10), we have 

A = y A,,, (46) 

x<y 

For computing the bound in (36), one needs to evaluate || Aa;/^y/Aa;^y|| for a; < y 
and x' < y'. Note that (A^,/y/Aj. y/)(,^) is possibly non null only if the indexes 
{x',y') and {x,y) have both elements in common (i.e. {x',y') = {x,y)) or if 
they have just one element in common. The latter occours if and only if 

X < y,x' < y' and (x = x' ,y ^ y' oi x ^ x', y = y' oi x = y',y ^ x' or x ^ y',y = x') 

(47) 

The next lemma provides closed-form expression for the quantities appearing 
in Table 1. 


Lemma 3 For a complete graph G with uniform weights uj{x,y) 

= S > 0 it 

holds 




l|A|| 

l> 

1 

1 

(48a) 


'4 

if (x', y') = (x, y) 


^^,y^x,y^x',y'^x',y' ~ '' 

1 

if {x',y') and {x,y) verify (47), 

(48b) 


.0 

if X ^ x' and y ^ y'. 


E 1 

Aa;/ 

,y,Ax,y\\=6‘^N‘^iN-l) . 

(48c) 

x<y,x'<y' 





Proof: In [3, pag. 269] it is shown that the non-zero eigenvalues of Af (A) are 
all equal to —N, when 5 = 1. In view of Theorem 1, these are the eigenvalues 
of A on and (48a) follows. A simple proof of the same fact is given next. 
From the graph completeness, one has Af{x) = —6Nf{x)+6 Jq f{y) dy. Then, 
A/ = A/, f G results in 

-6Nf{x)+6 [ fiy) dy = \f{x) 

^ G 
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and since the average of / is zero, 


-SNfix) = \f{x) 

so proving that the eigenvalues of A on are all equal to —N6. 

Formula (48b) is obtained directly. When {x', y') = (x, y) we have that 
has all zero entries except the elements {x,x), {y,y) (that are equal to 2) and 
{x,y), {y,x) (that are equal to —2). The minimal eigenvalue of is 

always —4. When {x',y') and {x,y) verify (47), one can show that up to a 
permutation of the agent indexes, which does not affect the results, it holds 


,y'Gx'^y' \ 


1-10 
-1 1 0 
y 0 0 Oy 


^^00 0 ^ 


0 1-1 
yO-1 ly 


^0 1 -1^ 
0 -1 1 
yO 0 0 y 


= 1 


Finally, from (48b), one gets 


E 

x<y^x'<y' 


T T 

^x,y^x,y^x',y'^x',y' 


= * E 1 + 1 E 1 («) 


x=x'<y=y' 


{x,y), {x',y') 
verifying(47) 


The first sum in the previous formula is equal to A(AiT)_ yg for the second 
sum, for a hxed pair {x,y), 1 < x < y < N one can show that the number of 
pairs {x', y') verifying 1 < x' < y' < N, x < y, x' < y' and 


X = X, y Y y' is N — X — 1 (50) 

y = y' is y-2 (51) 

X = y, y Y x' is x — 1 (52) 

X Y y' 1 y = x' is N — y (53) 


Then, 

^ 1 = EEzll(iV-a;-l + |/-2 + a;-l + A-|/) = N{N-l){N-2) 

{x,y), (x',y') 
verifying(47) 

(54) 

and one finally gets 


E 

x<y^x'<y' 


^x,y^x,y^x' ,y'^x' ,y' 


N{N - 1) 
2 


^N{N-l){N-2) = N^{N-1) (55) 
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From (45), one has that ,y') = ^'^^x,yGx,y^x'^y>■ and formula (48c) 

follows. 


7.1.2 Loop-shaped graph 

We now analyze the case of a loop-shaped graph with uniform weights where 
each agent exchanges information only with two other ones. More precisely, 
the set of edges is given by = {(1, 2), (2, 3),..., (iV — 1, iV), (iV, 1)} and 
uj{x,y) =6 > 0 if (x, y) G As in Section 7.1.1, we associate a different delay 
to each edge. Then, V = {xx^y, {x,y) G X}, where I = S. The operators Ax^y 
are dehned as in (44) and their matrix representation is given in (45). The 
matrix representation of A is given by 

M{A) = 6 (-21 M + Pn + Pn) ® Id (56) 

. where P/v ^ is the permutation matrix 


Pn = 


/o 0 ••• 0 l\ 
1 0 ••• 0 0 
0 1 ••• 0 0 

\0 0 ••• 10 / 


(57) 


The decomposition (10) becomes 

A 6 Cx^yG^ y 0 Id , 

(x,y)&I 


where the dehnition of ex,y, has been given in Section 7.1.1. 

The counterpart of Lemma 3 is stated next. 

Lemma 4 For a loop-shaped graph G with uniform weights u{x,y) = 5 > 0 
it holds 


l|A|| 


4sin^ 


N 

Y 

E 


TT 

N 


(A) 


-1 


-1 


= 4(5 sin^ 


l|A 


x',y 


’Ax,y\\ = QS^N. 





(58a) 

(58b) 


Proof: As is well-known, = P^^ and the eigenvalues of Pn are all 
the A-th roots of the unit, i.e. Ap^ = exp(^), k = 1,..., N. An eigenvalue 
A of Af(A) fulhlls the equation 

(P/v + PY)'4’ — A = A -|- 2 
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from which A = Xp^ + Xp^ = 2cos(^^). Then, A = 2cos(^^) — 2 = 
—4sin^ From Theorem 1, a nonzero A is an eigenvalue of A on This 

allows to deduce the identities in (58a). 

From identity (48b), it turns out that 


E 

{x,y)el,{x',y')€l 


^^,y^x,y^x' ,y'^x’ ,y' 


4 y 1 + 1 y 1 

verifying (47) 


(59) 


The hrst sum in (59) is equal to N. By direct calculation, the number of pairs 
{x,y) G X that verify (47) for a given pair {x',y') G X is 2. Therefore, since 
the number of possible pairs {x', y') G X is A, one has that the total number 
of pairs (x', y') and (x, y) that verify (47) is 2N. Then, one obtains 


E 

{x,y)&X,{x’ ,y')£l 


^x,y^x,y^^' ,y'^x' ,y' 


AN + 2N = 6N 


From (45), one has that M.{Nx^y^x',y') = ^‘^^x,yex^yex',y'epy,. and formula 
(58b) follows. ■ 

The delay margins obtained by applying the results summarized in Table 1 
are given now in Tables 2 and 3, for each of the two networks. 


r 

Uniform delays 

Non-uniform delays 

Time-invariant delays 

TT 

2SN 

TT 

2SN 

Time-varying delays 

3 

2SN 

1 

<57V(V-1) 


Table 2 

Complete graph: Bounds on the worst-case stabilizing delays 


8 Conclusions 

We provided convergence analysis of an average consensus protocol for undi¬ 
rected networks of dynamic agents having communication delays. We consid¬ 
ered constant or time-varying delays, uniformly or non uniformly distributed in 
the network. Sufficient conditions (also necessary in most cases) for existence 
of average consensus under bounded, but otherwise unknown, communication 
delays, have been given. Simulations have been provided that demonstrate 
adequation with the bounds computed analytically. 
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T 

Uniform delays 

Non-uniform delays 

Time-invariant delays 

TT 

TT 

86sin2(LfJt) 

85sin2(LfJt) 

Time-varying delays 

3 

2 sin^ i 

86sin2([fJ^) 

35N 


Table 3 

Loop-shaped graph: Bounds on the worst-case stabilizing delays. 
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